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(54) Image processing apparatus, image processing method, and recording medium 



(57) Viewing of a program at optimum image quality 
is realized. A correspondence table of combinations of 
MPEG video encoding parameters and image signal 
processing parameters is stored in a RAM. A CPU reads 
out an image signal processing parameter correspond- 



ing to a combination of MPEG video encoding parame- 
ters supplied from a demultiplexer from the RAM, and 
on the basis of the image signal processing parameter, 
controls an image signal processing in an image signal 
processing portion. 



FIG. 4 



1: TELEVISION RFCFIVFR 



CM 
< 
O 

CO 
CO 

in 



Q. 

Ill 



2 



- IF DEMODULATOR 



TS 



TS 



A 



DEMULTIPLEXER 















MPEG VIDEO 


YCbCr 


IMAGE SIGNAL 
PROCESSING 
PORTION 


_RG3^_ 


IMAGE DISPLAY 
PORTION 




DECODER 








Printed by Jouvo, 76001 PARIS (FR) 

06/05/2004, EAST Version: 1.4.1 



1 



EP1 156 670 A2 



2 



Description 

[0001] The present invention relates to an image 
processing apparatus, an image processing method, 
and a recording medium, and particularly to an image 
processing apparatus, an image processing method, 
and a recording medium. 

[0002] In recent years, digital broadcasting has begun 
in earnest. In the digital broadcasting, data such as an 
image or sound is compressed by an MPEG (Moving 
Picture Experts Group) system or the like and is broad- 
casted. 

[0003] In digital television broadcasting, since the da- 
ta is compressed, as compared with analog television 
broadcasting, a multi-channel and high quality content 
(program) can be broadcasted. 
[0004] In a conventional television receiver, a function 
of setting various image qualities is added, and the im- 
age quality can be adjusted according to the taste of a 
user. When many kinds of contents, such as a still image 
and a character figure, in addition to a normal moving 
image, come to be broadcasted by the development of 
the digital television broadcasting, a more diversified 
and delicate image quality adjustment is desired. 
[0005] However, since the setting of image quality in 
the conventional television receiver is performed by a 
manual operation while a user confirms a displayed im- 
age with the naked eye, delicate setting becomes diffi- 
cult, and eventually, the user does not adjust the image 
quality for each program, but usually watches any pro- 
gram at the same image quality. As a result, there has 
been a problem that a high-grade function of the televi- 
sion receiver can not be sufficiently exhibited. 
[0006] Various respective aspects and features of the 
invention are defined in the appended claims. 
[0007] Embodiments of the present invention enable 
a user to always watch a program at optimum or at least 
improved image quality by automatically changing the 
setting of a screen display (e.g. an image quality setting) 
In accordance with the program. 
[0008] An image processing apparatus of the present 
invention is characterized by comprising extraction 
means for extracting image data of a program selected 
by a user, acquisition means for acquiring image encod- 
ed information of the program extracted by the extrac- 
tion means, and setting means for setting a signal 
processing parameter for processing an image signal of 
the program, in accordance with the image encoded in- 
formation. 

[0009] The extraction means of the image processing 
apparatus of the present Invention may extract the im- 
age data of the program from a transport stream, and 
the acquisition means may acquire the image encoded 
information of the program from service information in- 
cluded in the transport stream. 
[0010] The image processing apparatus of the 
present invention can further comprise storage means 
for storing the signal processing parameter for process- 



ing the image signal. 

[0011] The Image processing apparatus of the 
present invention can further comprise changing means 
for changing the signal processing parameter by an in- 

5 put from the user. 

[0012] An image processing method of the image 
processing apparatus of the present invention is char- 
acterized by comprising an extraction step of extracting 
image data of a program selected by a user, an acqui- 

10 sition step of acquiring image encoded information of 
the program extracted by processing at the extraction 
step, and a setting step of setting a signal processing 
parameter for processing an image signal of the pro- 
gram, in accordance with the image encoded informa- 
tion. 

[0013] A program of a recording medium of the 
present invention is characterized by comprising an ex- 
traction step of extracting image data of a program se- 
lected by a user, an acquisition step of acquiring Image 
encoded information of the program extracted by 
processing at the extraction step, and a setting step of 
setting a signal processing parameter for processing an 
image signal of the program, in accordance with the im- 
age encoded information. 

[0014] In the image processing apparatus, the image 
processing method, and the recording medium accord- 
ing to the present invention, the signal processing pa- 
rameter for controlling the display of a picture of the pro- 
gram is set in accordance with the image encoded in- 
formation of the program selected by the user. Accord- 
ingly, it becomes possible to watch the program easily 
at the optimum screen quality without carrying out a 
complicated operation. 

[0015] The invention will now be described by way of 
example with reference to the accompanying drawings, 
throughout which like parts are referred to by like refer- 
ences, and in which: 

FIG. 1 is a block diagram showing a structural ex- 
ample of a television receiver to which the present 
invention is applied; 

FIG. 2 is a flowchart for explaining the operation of 
the television receiver of FIG. 1 ; 
FIG. 3 is a view showing an example of MPEG video 
encoding parameters; and 
FIG. 4 is a block diagram showing a structural ex- 
ample of another television receiver to which the 
present invention is applied. 

[0016] FIG. 1 shows a structural example of a televi- 
sion receiver 1 which receives a digital broadcast trans- 
mitted from a not-shown broadcasting station and dis- 
plays (outputs) an image and sound. 
[0017] An IF demodulator 2 demodulates an IF (Inter- 
mediate Frequency) signal obtained from a digital 
broadcast wave received by a not-shown antenna and 
outputs it as a transport stream to a demultiplexer 4. 
[0018] Besides, a transport stream transmitted from 
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a CATV system, a network system or the like is supplied 
to the demultiplexer 4 through a transmission path 3. 
[0019] The demultiplexer 4 separates a TS packet in- 
cluding image data from transport stream packets (here- 
inafter suitably referred to as TS packets) constituting 
the supplied transport stream, and outputs it to an 
MPEG video decoder 5. 

[0020] The TS packet holding the image data is de- 
coded in the MPEG video decoder 5, and is outputted 
to an image signal processing portion 6. Besides, MPEG 
video encoding parameters Indicating information In re- 
lation to the encoding of the TS packet which is sepa- 
rated in the MPEG video decoders and holds the image 
data are outputted to a CPU (Central Processing Unit) 8. 
[0021] The image signal processing portion 6 gener- 
ates an RGB signal from a decoded luminance signal 
and color-difference signal, and displays an image on 
an Image display portion 7 Including a CRT (Cathode- 
Ray Tube) or an LCD (Liquid Crystal Display). 
[0022] The CPU 8 controls respective portions in re- 
sponse to an input from a user interface 1 0 for outputting 
a signal corresponding to an operation of a user. Data 
and programs necessary for the CPU 8 to execute var- 
ious processes are stored in a RAM 9. 
[0023] An HDD (Hard Disk Drive) 1 02, a ROM (Read 
Only Memory) 103, and a drive 104 are connected to 
the CPU 8 through a bus 101. As a recording medium, 
a magnetic disk 1 11 , an optical disk 1 1 2, a magneto-op- 
tical disk 113, or a semiconductor memory 114 is mount- 
ed on the drive 1 04. 

[0024] Next, the operation of the television receiver 1 
of FIG. 

[0025] 1 will be described with reference to a flowchart 
of FIG. 2. 

[0026] At step S1 , the IF demodulator 2 demodulates 
an IF signal obtained from a digital broadcast wave re- 
ceived by a not-shown antenna, generates a transport 
stream, and outputs it to the demultiplexer 4. 
[0027] At step S2, the demultiplexer 4 separates a TS 
packet holding video data of an objective program from 
PSI (Program Specific Information) and Si (Service In- 
formation) included in the supplied transport stream, 
and outputs it to the MPEG video decoder 5. The PSI 
means specification information of a program (broad- 
cast program) prescribed by the MPEG, and is consti- 
tuted by four tables of a PAT (Program Association Ta- 
ble), a PMT (Program Map Table), a NIT (Network Infor- 
mation Table), and a CAT (Conditional Access Table) 
and various descriptors. The SI is information which a 
broadcasting business body uniquely uses. 
[0028] At step S3, the MPEG video decoder 5 de- 
codes the TS packet including the video data by the 
MPEG system, generates a luminance signal (Y) and 
color-difference (Cr, Cb) signals, and outputs them to 
the image signal processing portion 6. In the present in- 
vention, in order to cause the optimum image to be dis- 
played on the image display portion 7, signal processing 
executed in the image signal processing portion 6 is 



controlled in accordance with the image signal process- 
ing parameter acquired by the CPU 8. Then, the MPEG 
video decoder 5 extracts the MPEG encoding parame- 
ters as shown in FIG. 3, which describe information in 
s relation to the encoding of the video data, and outputs 
them to the CPU 8. 

[0029] In an example of the M PEG video encoding pa- 
rameters of FIG. 3, profile/level designation is MP/HL 
(Main Profile/High Level), the number of horizontal plx- 
10 els is 1 920, the number of vertical lines is 1 080, an as- 
pect ratio Is 1 6:9 display, a bit rate is 22 Mbps, a frame 
rate is 30/1 .001 Hz, a scan system is a sequential scan- 
ning (progressive scanning) system, a color initial value, 
a conversion characteristic, and a matrix coefficient are 
'5 prescribed values of ITU-R recommendation BT. 709, 
and a repeat first flag is a flag used at 2:3 pull down. 
[0030] At step S4, the CPU 8 searches and sets im- 
age signal processing parameters corresponding to a 
combination of the MPEG video encoding parameters, 
which are supplied from the MPEG video decoder 5, 
from a correspondence table of the MPEG video encod- 
ing parameters and the image signal processing param- 
eters, which is previously stored in the RAM 9. For ex- 
ample, in the case where the combination of the sup- 
plied MPEG video encoding parameters is such that 
profile/level is MP/HL, the number of display pixels/ 
frame rate is 1920 X 1080/24P, and the bit rate is 22 
Mbps, the CPU 8 recognizes that the image data of the 
TS packet extracted from the transport stream is a mov- 
ie of high image quality, and acquires and sets such im- 
age signal processing parameters as to lower the bright- 
ness, as to attenuate the sharpness, as to lower color 
temperature, as to cut NR (Noise Reduction), as to cut 
VM (Velocity Modulation (beam velocity modulation)), 
and as to strengthen gamma correction, from the corre- 
spondence table of the combination of the MPEG video 
encoding parameters and the image signal processing 
parameters, which is stored in the RAM 9. On the basts 
of these image signal processing parameters, the CPU 
8 controls the signal processing in the image signal 
processing portion 6, so that all of delicate gradation of 
a dark portion, a profile, and color can be displayed with 
a soft touch, and the quality of an original film can be 
displayed. 

[0031] At step S5, on the basis of the image signal 
processing parameters set by the CPU 8, the image sig- 
nal processing portion 6 processes the luminance signal 
and the color-difference signals supplied from the 
MPEG video decoder 5, generates an RGB signal, and 
outputs it to the image display portion 7. 
[0032] At step S6, the image display portion 7 displays 
an image on the basis of the RGB signal supplied from 
the image signal processing portion 6. 
[0033] In the above, although the signal processing in 
the image signal processing portion 6 is controlled on 
the basis of the image processing parameters, as shown 
in FIG. 4, it is also possible to further control the image 
display portion 7. 
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[0034] In the present embodiments, it is also possible 
to change the setting of the image signal processing pa- 
rameters in such a manner that the user operates the 
user interface 1 0 according to the taste of the user. Here, 
the image signal processing parameters the setting of 
which is changed are stored in the RAM 9, and thereaf- 
ter, also in the case where the same program (series 
program) is selected by the user, the signal processing 
in the image signal processing portion 6 and the image 
display portion 7 is controlled on the basis of the same 
Image signal processing parameters, and the Image is 
displayed. 

[0035] The present invention can also be applied to 
an audio signal. For example, in the case where signal 
processing as to data of a music program is carried out, 
with respect to a video signal, the above described im- 
age signal processing is carried out and is displayed, 
and with respect to the audio signal, sound signal 
processing parameters are set from a combination of 
MPEG audio encoding parameters , and a sound signal 
processing portion and a sound output portion can be 
controlled as well. 

[0036] Further, in the case where a plurality of images 
are displayed on a plurality of windows of one screen at 
the same time, a display (output) may be controlled for 
each of the images displayed on the respective win- 
dows, 

[0037] In the above, although the description has 
been made on the case where the present invention is 
applied to the television receiver, the present invention 
can be applied to any devices (for example, a personal 
computer, etc. ) which process digital data, including an 
IRD (Integrated Receiver/Decoder). 
[0038] Although the foregoing series of processes 
can be executed by hardware, they can also be execut- 
ed by software. In the case where the series of process- 
es are executed by software, a program constituting the 
software is installed from a recording medium to a com- 
puter Integrated in dedicated hardware, or, for example, 
a multi-purpose personal computer which can execute 
various functions by installing various programs. 
[0039] As shown in FIG. 1 , this recording medium is 
constituted not only by a package medium which is sep- 
arate from a computer and is distributed to the user to 
provide a program and in which the program is recorded, 
such as the magnetic disk 111 (including a floppy disk), 
the optical disk 112 (including a CD-ROM (Compact 
Disk-Read Only Memory), and a DVD (Digital Versatile 
Disk)), the magneto-optical disk 113 (including MD 
(Mini-Disk)), orthe semiconductor memory 11 4, but also 
by the ROM 103 or the HDD 102 which is provided to 
the user in the state where it is previously integrated in 
the computer and in which the program is recorded. 
[0040] Incidentally, in the present specification, steps 
describing the program recorded in the recording medi- 
um naturally include processes carried out in time series 
along the recited sequence, and also include processes 
which are not necessarily processed in time series but 



are executed in parallel or individually. 
[0041] Besides, in the present specification, the sys- 
tem indicates an entire apparatus constituted by a plu- 
rality of devices. 

5 [0042] In so far as the embodiments of the invention 
described above are implemented, at least in part, using 
software-controlled data processing apparatus, it will be 
appreciated that a computer program providing such 
software control and a storage medium by which such 

10 a computer program is stored are envisaged as aspects 
of the present Invention. 

Claims 

15 

1. An image processing apparatus for receiving and 
processing image data of a predetermined pro- 
gram, comprising: 

20 extraction means for extracting the image data 

of the program selected by a user; 
acquisition means for acquiring image encoded 
information of the program extracted by the ex- 
traction means; and 
25 setting means for setting a signal processing 

parameterfor processing an image signal of the 
program, in accordance with the image encod- 
ed Information. 

30 2. The image processing apparatus according to claim 
1, wherein: 

the extractionmeans extracts the image data of 
the program from a transport stream; and 
35 the acquisition means acquires the image en- 

coded information from service information in- 
cluded in the transport stream. 

3. The Image processing apparatus according to claim 
40 1 ( further comprising storage means for storing the 

signal processing parameter. 

4. The image processing apparatus according to claim 
3, further comprising changing means forchanging 

45 the signal processing parameter by an input from 
the user. 

5. The image processing apparatus according to claim 
1, further comprising processing means for 

50 processing the image signal of the program in ac- 
cordance with the signal processing parameter set 
by the setting means. 

6. The image processi ng apparatus according to claim 
55 1 ( further comprising display means for displaying 

the processed image signal of the program. 

7. The image processing apparatus according to claim 
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6, wherein the display means is further controlled in 
accordance with the image encoded information. 

8. An image processing method of an image process- 
ing apparatus for receiving and processing image s 
data of a predetermined program, comprising: 

an extraction step of extracting the image data 
of the program selected by a user; 
an acquisition step of acquiring image encoded 10 
information of the program extracted by 
processing at the extraction step; and 
a setting step of setting a signal processing pa- 
rameter for processing an image signal of the 
program, in accordance with the image encod- *s 
ed information. 

9. The image processing method according to claim 
8, wherein: 

20 

at the extraction step, the image data of the pro- 
gram is extracted from a transport stream; and 
at the acquisition step, the image encoded in- 
formation is acquired from service information 
included in the transport stream. 25 

10. The image processing method according to claim 
8, further comprising a storage step of storing the 
signal processing parameter. 

30 

11. The image processing method according to claim 
1 0, further comprising a changing step of changing 
the signal processing parameter by an input from 
the user. 

35 

12. The image processing method according to claim 
8, further comprising a processing step of process- 
ing the image signal of the program in accordance 
with the signal processing parameter set at the set- 
ting step. 40 

13. The image processing method according to claim 
8, further comprising a display step of displaying the 
processed image signal of the program. 

45 

14. The image processing method according to claim 
13, wherein the image signal of the program at the 
display step is further controlled in accordance with 
the image encoded information. 

50 

15. A recording medium storing a computer readable 
program, in which the program of an image process- 
ing apparatus for receiving and processing image 
data of a predetermined program comprises: 

55 

an extraction step of extracting the image data 

of the program selected by a user; 

an acquisition step of acquiring image encoded 



information of the program extracted by 
processing at the extraction step; and 
a setting step of setting a signal processing pa- 
rameter for processing an image signal of the 
program, in accordance with the image encod- 
ed information. 
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FIG. 2 



( START ) 



IF DEMODULATOR DEMODULATES AN INPUTTED IF SIGNAL, 
GENERATES TS AND OUTPUTS IT TO A DEMULTIPLEXER 



■SI 



THE DEMULTIPLEXER SEPARATES A TS PACKET OF AN 
OBJECTIVE PROGRAM FROM PSI/SI OF THE INPUTTED 
TS, AND OUTPUTS IT TO AN MPEG VIDEO DECODER 



■S2 



THE MPEG VIDEO DECODER EXTRACTS MPEG VIDEO 
ENCODING PARAMETERS FROM THE SUPPLIED TS 
PACKET, OUTPUTS THEM TO A CPU, AND OUTPUTS SIGNALS 
OF YCbCrTO AN IMAGE SIGANAL PROCESSING PORTION 



S3 



THE CPU SETS IMAGE SIGNAL PROCESSING PARAMETERS ON 
THE BASIS OF THE MPEG VIDEO ENCODING PARAMETERS, AND 
CONTROLS THE IMAGE SIGNAL PROCESSING PORTION ON THE 
BASIS OF THE SET IMAGE SIGNAL PROCESSING PARAMETERS 



S4 



THE IMAGE SIGNAL PROCESSING PORTION PROCESSES THE 
YCbCr SIGNALS INPUTTED FROM THE MPEG VIDEO DECODER 
ON THE BASIS OF INSTRUCTION FROM THE CPU, GENERATES AN 
RGB SIGNAL, AND OUTPUTS IT TO AN IMAGE DISPLAY PORTION 



•S5 



THE IMAGE DISPLAY PORTION DISPLAYS THE RGB SIGNAL 
INPUTTED FROM THE IMAGE SIGNAL PROCESSING PORTION 



■S6 



( END ) 
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